Self-Organization and Entropy Decreasing in Neural Networks
نویسندگان
چکیده
منابع مشابه
Self-Organization and Entropy Decreasing in Neural Networks
Dynamics of self-organization of binary patterns in a Hopfield model, a Boltzmann machine and a chaos neural network are investigated with the use of an ensemble average entropy and a short time average entropy. Time dependences of these entropies are calculated by numerical simulations when these models are solving traveling salesman problems. Decreasing of the entropies are observed in conseq...
متن کاملSelf-Organization and Emergence in Neural Networks
The interest for neural networks stems from the fact that they appear as universal approximators for whatever kind of nonlinear dynamical system of arbitrary complexity. Because nonlinear systems, are studied mainly to model self-organization and emergence phenomena, there is the hope that neural networks can be used to investigate these phenomena in a simpler way, rather than resorting to nonl...
متن کاملSelf-Organization in Stochastic Neural :Networks
The maximization of the Mutual Information between the stochastic outputs neurons and the clamped inputs is used as unsupervised criterion for training a Boltzmann Machine. The resulting learning rule contains two terms comsponding to the Hebbian and anti-Hebbian learning, The two terms are weighted by the amount of transmitted information in the learning synapse, giving an information-theoreti...
متن کاملSpatial Organization Using Self-Organizing Neural Networks
Spatial hypertext systems use physical properties as color, dimensions, and position to represent relationships between documents. These systems allows the user to express a lot of different relationships between information but the structure should be build by hand by the user. This can be complex if a large number of information is involved. Self-organizing neural networks map can automatical...
متن کاملSelf-Organisation in Recurrent Neural Networks using Transfer Entropy
Oliver Obst, 2, ∗ Joschka Boedecker, 4 Minoru Asada, 4 and Mikhail Prokopenko CSIRO Information and Communications Technology Centre PO Box 76, Epping, NSW 1710, Australia School of Information Technologies, The University of Sydney, NSW 2006, Australia Department of Adaptive Machine Systems, Osaka University, Suita, Osaka, Japan JST ERATO Asada Synergistic Intelligence Project, Suita, Osaka, J...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Progress of Theoretical Physics
سال: 1994
ISSN: 0033-068X,1347-4081
DOI: 10.1143/ptp/92.5.927